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Abstract 

The proton-proton and proton-?/' invariant mass distributions have been determined for the pp 
pprj' reaction at an excess energy of Q = 16.4 MeV. The measurement was carried out using the 
COSY- 1 1 detector setup and the proton beam of the cooler synchrotron COSY. The shapes of the 
determined invariant mass distributions are similar to those of the pp — > pprj reaction and reveal 
an enhancement for large relative proton-proton momenta. This result, together with the fact that 
the proton-77 interaction is much stronger that the proton-?;' interaction, excludes the hypothesis 
that the observed enhancement is caused by the interaction between the proton and the meson. 

Keywords: pseudoscalar mesons, differential distributions, near threshold meson production, 
interaction 
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1. Introduction 

The understanding of the meson-nucleon interaction as well as studies of meson structure and 
production mechanisms constitute one of the basic issues of the contemporary hadron physics. 
The T] and rj' mesons constitute a mixture of the SU(3) singlet and octet states with almost the 
same relative contributions of various quark flavours. Nevertheless, they have unexpectedly dif- 
ferent properties, e. g. as regards the mass f 1], branching ratios or production cross sections 

These differences indicate that also the interaction of rj and rj' mesons with nucleons may be 
diff'erent. 

Up to now, the proton-?/ interaction was studied intensively but still rather large range of val- 
ues of the scattering length is reported depending on the analysis method tSJ. The proton-?;' 
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interaction is much less known. It is only qualitatively estimated (based on the pp pprj' 
excitation function) to be much weaker than for the proton-// system |6]. In principle, stud- 
ies of pp ^ pp meson reactions permit information about the proton-meson interaction to be 
gained not only from the shape of the excitation function but also from differential distribu- 
tions of proton-proton and proton-meson invariant masses. Therefore, in order to investigate the 
proton-77 interaction the COSY- 11 collaboration performed a measurement ^ of the proton-?/ 
and proton-proton invariant mass distributions close to the threshold at Q = 15.5 MeV, where 
the outgoing particles possess small relative velocities. Indeed a large enhancement in the re- 
gion of small proton-;/ and large proton-proton relative momenta was observecfl However, the 
observed effect cannot be univocally assigned to the influence of the proton-;/ interaction in the 
final state [8^ since it can also be explained by the admixture of higher partial waves in the 
proton-proton system ifToll , or by the energy dependence of the production amplitude 111, 121. 

The endeavor to explain the origin of the observed enhancement motivated the measurement 
of the proton-proton and proton-;/' invariant mass distributions for the pp — » pprj' reaction 
presented in this article. 

If the enhancement observed in the proton-proton invariant mass distributions for the pp ^ 
ppT] reaction would be due to the proton-;/ interaction then it is expected to be significantly lower 
for the pp — > ppT}' reaction since the proton-;/ interaction is stronger than the proton-;/' 

In order to make a model independent comparison of the spectra in the pprj and pprj' systems 
we performed a measurement of the pp ^ pprj' reaction, nominally at the same excess energy as 
previously measured for the pp — > pprj reaction. Invariant mass spectra determined at the same 
excess energies allow for the comparison without a need for a correction of kinematical factors 
in the outgoing system. 

It is important to stress that the invariant mass distributions for the pp pprj' reaction have 
not been measured so far This is because the total cross section for the rj' meson production 
in hadron collisions is by more than a factor of 30 smaller than the one for the rj meson at the 
same excess energy and additionally the total cross section for the production of the multi-pion 
background grows by three orders of magnitude when the beam energy increases from the rj to 
the 7]' production threshold ifisll . A determination of the invariant mass spectra reported in this 
letter was made possible due to stochastic cooling of the proton beam of the COSY synchrotron 
HHEB and the good momentum resolution {cr-4 MeV/c) P] achieved with the COS Y- 
1 1 detector setup designed especially for measurements near the kinematical threshold. Suffi- 
cient statistics were collected to allow the background to be subtracted from the invariant mass 
distributions. 

Detailed description of the COSY- 11 method used for the pp ^ pprj' reaction measure- 
ments can be found in therefore, here we concentrate on the background subtraction 
procedure crucial for the determination of invariant mass distributions. 



2. Experiment and data analysis 



The measurement of the pp 
COSY 1 14] and the COSY- 11 detector setup 121 
Pb 



pprj' reaction was conducted using the cooler synchrotron 



22l 12311 at the proton beam momentum of 
3.260 MeV/c, which corresponds to an excess energy of Q = 16.4 MeV. It was based on 



the registration of the two outgoing protons and reconstruction of their momenta. The rj' meson 



The same enhancement was also seen in independent measurements by the COSY-TOF group 0). 
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is identified using the missing mass technique. 

Figure[T]illustrates a schematic view of the COSY- 1 1 apparatus with a topology of the pp ^ ppX 
reaction. Two outgoing protons possessing smaller momenta than the beam momentum are bent 
in the dipole magnetic field towards the detector system leaving the vacuum chamber through the 
exit window. Afterwards, they are detected in the two drift chambers, Dl and D2, in the scintilla- 
tor hodoscopes SI and S2, and in the scintillator wall S3. The targej^used during the experiment, 
was realized as a beam of H2 molecules grouped inside clusters of up to about 10^ atoms. The 
average density of the target was around 5 ■ lO''' atoms/cm^ 1,24.1 . It was installed in front of the 
dipole magnet as it can be seen schematically in Figure [1] 

In order to determine the absolute values of the differential cross sections, the time integrated 
luminosity (L) has been established by the concurrent measurement of the angular distribution of 
the elastically scattered protons [S]. The extracted value of the integrated luminosity amounts 
toL = (5.859 ± 0.055) pfc-' [26i1. 

In order to search for small effects like proton-meson interaction it is of importance to account 
for smearing of the measured distributions due to the finite resolution of the detector system, 
which may alter the shape of the spectrum especially close to the kinematical limit. Therefore, 
as has been done previously in the analysis of the pp — > pprj reaction (0], a kinematical fitting 
of the data has been performed [26] in order to improve resolution. To this end, the momenta 
of the protons were varied demanding that the missing mass of the unregistered particle equals 
the known mass of the 77' meson exactly. Furthermore, as a result of the fit, only those proton 
momentum vectors which were closest to the vectors determined from the experiment have been 
chosen. The inverse of the covariance matrix was used as a metric for the distance calculation. 
The kinematical fit improves the resolution by a factor of 1 .5, as can be seen in Figure|2] After the 
kinematical fit each event can be characterized by both: experimentally determined momentum 
vectors and kinematically fitted momenta. In the subsequent analysis the fitted momenta were 
used to group events into Spp and Spif intervals and then in order to subtract the background, for 
each group separately, a missing mass spectrum was determined from experimental momentum 
vectors. The available range of Spp and Sp,j' was divided into 22 bins. The width of the bins 
(0.003 GeV^/c^) was chosen as a compromise between statistics and the experimental resolu- 
tion. Then, for each bin, the missing mass spectrum was reconstructed and the number of the 
pp — > ppj]' events was calculated separately for each interval of Spp, Spr,'. 
In Figure [3] examples of missing mass spectra for two intervals of the invariant proton-proton 
mass are presented. A clear signal from the 77' meson production is seen on top of a continuous 
spectrum from the multi pion background. A smooth behaviour of the background allows one 
to interpolate its shape under the 77' peak with polynomial functions that match the data below 
and above the peak. The smooth behaviour of the multi-pion background in the peak region was 
verified by Monte Carlo simulations [26J. In both panels of Figure[3]the dotted lines correspond 
to the result of the fit of the second order polynomial. An equally good approximation of the 
background was also achieved by a fit of the sum of two Gaussian distributions 1I26I1 . The pa- 
rameterizations were performed in the entire range of missing mass outside of the pp pprj' 
signal, and obviously reproduce the background very well. 

The situation is more complicated for these missing mass spectra when the signal is close to 
the kinematical limit (see Fig. |4]l. In this case the shape of the background on the right side of 
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the peak cannot be easily predicted. Such spectra are obtained for kinematical regions of higher 
squared invariant proton-proton masses and relatively low squared invariant proton-77' masses. In 
order to describe the shape of the background in these regions, the pp — > pplnr], pp — » pplin 
and pp ^ ppAn reaction^ have been generated and the simulated events were analysed in the 
same way as for the experimental data. The result of these simulations (dashed lines) is com- 
pared to the experimental data in Figure |4] The simulations of the different reaction channels 
were performed with a distribution based on an equal population of phase space including the 
proton-proton final state interaction [6.. .27.1 . A linear sum of the simulated missing mass spectra 
was matched to the data with the relative magnitudes as the only free parameters. In both exam- 
ples, simulations are in a good agreement with the experimental background distributions below 
the T]' peak. Moreover the behaviour of the simulated background matches the kinematical limit 
of the missing mass distributions. 

For the dynamics of the pion production, it had been assumed that pions are produced uniformly 
over the available phase space. As described in reference [21] the shape of the missing mass 
spectrum does not change significantly at the edge of the kinematical limit if one assumes reso- 
nant or direct pion production. 

In order to increase the confidence in the estimation of the background behaviour near the kine- 
matical boundary and to estimate the systematic uncertainties due to the choice of the background 
parameterizations, these distributions were described in an independent way with a second order 
polynomial divided by the Fermi function for the description of the rapid slope at the end of the 
distributions. To this end, the following formula was applied: 

F(mm,a,b,c,d,g) = (a + b ■ mm + c-mm^)/(l + e*""" - -i)/?), (1) 

where a, b, c, d and g are free parameters. 

The results are presented in Figure |4] as dotted lines. It is seen that under the 77' peak the result 
of Equation [1] agrees well with the background determined from the simulations and that both 
reproduce the shape of the slope quite well. 

A further check of the background was performed by extracting the missing mass distributions 
for regions of the squared invariant masses of proton-proton and proton-meson where the 77' is 
not produced. The resulting missing mass distributions are shown in Figure |5] and represent the 
regions of low squared invariant masses of the proton-meson subsystem (left) and high squared 
invariant masses of the proton-proton subsystem (right). For such values of Spp or Spri' the pro- 
duction of the rj' meson is not kinematically allowed because Sprj' < (irip + in,y)^ and Spp is too 
large leaving insuflicient energy to create the rj' meson. The simulations reproduce the back- 
ground very well as one can see in Figure |5] 

The main contribution to the systematic uncertainty of the determined differential cross sections 
comes from the uncertainty of the estimation of the yield of the 77' events which, in turn, is due 
to the assumption of the shape of the background. In order to estimate these errors, the num- 
bers of background events extracted under the two diff'erent assumptions were compared. For 
the missing mass spectra with the signal far from the kinematical limit, the background deter- 
mined by Gaussian distributions was compared to the background estimated by a second order 
polynomial. For the spectra close to the kinematical limit, the background determination by 



^ These reaction channels were chosen as a representation of the possible multi-pion production background, since 
contribution from the pp — ► pp5n,6!Tj7T reactions can be neglected 1 18] and the missing mass spectrum from Irr has a 
similar shape as those for 3n and An in the relevant kinematical region. 
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Monte-Carlo simulations was compared to a second order polynomial divided by the Fermi dis- 
tribution. The uncertainty of the background estimation constitutes the main contribution to the 
systematic error of the differential cross sections. The differences in the number of background 
events obtained by applying the above described different fit procedures are below 3% of the 
background value, which corresponds to about 20% of the signal, as can be seen for instance in 
Figure H] 

Finally, the measured distributions were corrected for the acceptance according to the method 
described elsewhere [4J. Here, it is important to stress that at the beam momentum of ps - 3.260 
GeV/c the COSY- 1 1 acceptance for the pp pprj' reaction is finite over the entire area of the 
Spp vs Sp^f Dalitz plot. This is shown in Figure|6] where one can see that the full phase space for 
the pp pprj' reaction is covered. 



3. Results 

A comparison of the Spp and yjSp^meson distributions between the pp pprj' and the 
pp — > pprj reactions is presented in Figure Q For the proton-meson system the comparison 
was performed for the kinetic energy ( y.Sp-,„e.son - nip — m„,gson) and not as a function of 
Sp-meson bccausc the range of the Sp,^ and Sp^l are different due to the different masses of the rj 
and rj' mesons. But the range of ( ^Sp-,„eson - nip - nimeson) is the same since the measurements 
for the 77 and 77' production were performed at about the same excess energ}0. 
In both panels it is seen that the shape of the distribution for the pp pprj measurement (open 
squares) is in agreement with that for the pp ^ pprj' reaction (closed squares) within the error 
bars, thus, showing the same enhancement in the region of large proton-proton invariant mass. 
Therefore, if the 77' -proton interaction is indeed much smaller than the ?7-proton as inferred from 
the excitation function , then, one would have observed a significantly smaller enhancement 
in the case of the meson. Hence, the spectra presented here tend to exclude the hypothesis that 
the enhancement is due to the meson-proton interaction. 

The absolute values of the cross section for the pp ^ pprj' reaction determined as a function of 
Spp and Sp,f are given in Tables[T]and|2l and are shown in Figure[8] The determined distributions 
differ significantly from the predictions based on the homogeneous phase space population (thick 
solid line). Also, the results of calculations including the FSIpp (dotted line) do not describe the 
data underestimating the cross sections at large values of Spp and low values of Sp,j. Similarly to 
the case of 77 meson, a better agreement with the experimental data can be achieved when taking 
into account contributions from higher partial waves. The calculations depicted as solid lines 
result from a combined analysis (based on the effective La grangian appro ach) of the production 
of Tj and Tj' mesons in photo- and hadro-induced reactions [ l^, 28, U 3^. Since the calculation 



is done in the plane-wave basis, not only the ^Pq — >'5os but also the ^Sq — (and all the 
higher partial-waves) transitioijf] contributes at the excess energy of 16.4 MeV. 
On the other hand, one can explain the enhancement seen in the distributions by an energy 
dependent production amplitude [1 1,1 . The result indicated by the dashed lines was obtained al- 
lowing for a linear energy dependence of the ^Pq -^^Sqs partial wave amplitude and neglecting 



The nominal beam energy corresponds to an excess energy of Q = 15.5 MeV, consistent with the data collected for 
the pp — * ppr; reaction. However, the real value was determined to be 16.4 MeV [26.1 . This difference is well within the 
precision of the absolute beam momentum adjustment of the COSY synchrotron amounting to about 6p/p = 10"' fT^ 
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other partial waves transitions fTl'|. Also, Ceci et al. 1 12| have shown recently that the discussed 
enhancement in the invariant mass spectra can be well described by the energy dependence of the 
production amplitude when the negative interference between the n and the rj meson exchange 
amplitudes is assumed. 

Within the statistical and systematic error bars both model of Nakayama et al.[10] and of 
Deloff 111 ill describe the data well although they differ slightly in the predicted shapes. Taking 
into account statistical uncertainties only, one obtains = 2.1 and;^'^ - 4.7 for the comparison 
of the dashed line and solid line to the data, respectively. This indicates that perhaps, not only 
higher partial waves but also the energy dependence of the production amplitude should be taken 
into account. 



4. Summary 

Using the COSY- 11 detector setup and the proton beam of the cooler synchrotron COSY 
the proton-proton and proton-;;' invariant mass distributions have been determined for the — > 
pprj' reaction at an excess energy of Q = 16.4 MeV. 

Similar to the earlier observation for the tj meson production the measured differential cross 
section distributions (spp and Sprj') for the pp ^ pprj' reaction at Q = 16.4 MeV strongly deviate 
from the predictions based on a homogeneous population of events over the allowed phase space. 
Also, the inclusion of the proton-proton final state interaction is not sufficient to explain the 
enhancement seen in the range of large Spp values. 

Within the achieved uncertainties, the shape of the proton-proton and proton-meson invari- 
ant mass distributions determined for the rj' meson is essentially the same to that established 
previously for the rj meson. Since the enhancement is similar in both cases, and the strength 
of proton-?; and proton-//' interaction is different flU^, one can conclude that the observed 
enhancement is not caused by a proton-meson interaction. 

Finally, calculations assuming a significant contribution of P-wave in the final state ifioll . 



and models including energy dependence of the production amplitude 01 IL 11211 . reproduce the 
data within error bars equally well. Therefore, on the basis of the presented invariant mass dis- 
tributions, it is not possible to disentangle univocaUy which of the discussed models is more 
appropriate. As pointed out in iTo*], future measurements of the spin correlation coefficients 
should help disentangle these two model results in a model independent way. 

Acknowledgements: 

The work was partially supported by the European Community-Research Infrastructure Activ- 
ity under the FP6 and FP7 programmes (Hadron Physics, RII3-CT-2004-506078, PrimeNet No. 
22743 1 .), by the Polish Ministry of Science and Higher Education under grants No. 3240/H03/2006/3 1 
and 1202/DFG/2007/03, by the German Research Foundation (DFG), by the FEE grants from the 
Research Center Jiilich, and by the virtual institute "Spin and strong QCD" (VH-VI-231). 



which coiTesponds to ~ 1 MeV uncertainty in Q. 

^The transition between angular momentum combinations of the initial and final states are described according to the 
conventional notation |31] in the following way: 

25'+!^, ^25 + 1 ^ (2) 
where, superscript "i" indicates the initial state quantities. S denotes the total spin of nucleons, and / stands for the 
overall angular momentum of the system. L and / denote the relative angular momentum of nucleon-nucleon pair and of 
the meson relative to the NN system, respectively. 
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Spp [GeV'/c^] 


^ [/ib/GeW] 




3.5215 


1.01 ± 


0.11,,a,± 


0. 1 '2.sys 


3.5245 


4.28 ± 


0.25, ± 


0.56,„ 


3.5275 


4.06 ± 


0.26„a, ± 


0.59,,, 


3.5305 


3.78 ± 


0.26„„, ± 




3.5335 


3.52 ± 


0.26,„„ ± 




3.5365 


2.74 ± 


0.25 ± 


0.46,,, 


3.5395 


1.99 ± 


0.23 ± 


0.40,,, 


3.5425 


2.75 ± 


0.25 ,to, ± 


0.40,,, 


3.5455 


2.23 ± 


0.23,,«, ± 


0.37,,, 


3.5485 


2.66 ± 


0.25 ± 


0.39,,, 


3.5515 


1.96 ± 


0.21,to,± 


0.30,,, 


3.5545 


2.18 + 


0.23,,«, ± 


0.34,,, 


3.5575 


1.93 ± 


0.22„„, ± 


0.31,,, 


3.5605 


1.62 ± 


0.22,to, ± 


0.33,,, 


3.5635 


1.76 + 


0.20,to, ± 


0.26,,, 


3.5665 


1.66 ± 


0.19„„, ± 


0.24,,, 


3.5695 


1.76 ± 


0.19,to,± 


0.26,,, 


3.5725 


1.39 ± 


0.16,to,± 


0.22,,, 


3.5755 


1.12± 


0.14„„, ± 


0.19,,, 


3.5785 


1.07 ± 


o.ii,„„± 


0.11,v, 


3.5815 


0.72 ± 


0.09„«, + 


0.09,,, 


3.5845 


0.013 ± 0.004s,a, 


± 0.002,,, 



Table 1: Differential cross section as a function of the squared invariant mass of the proton-proton system, for the 
-» ppif reaction at Q = 16.4 MeV. 
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sp,, [GeV'/c^] ^ U/b/GeV^/c*] 



3.5945 


0.14 ± 




± 


0.02,3,, 


3.5975 


0.76 ± 


0.06 


+ 


0.09,v, 


3.6005 


1.25 ± 




± 


0.14,y, 


3.6035 


1.32 ± 


O.lOsta, 


± 


0.17,3,, 


3.6065 


1.62 ± 




+ 


0.24,,, 


3.6095 


1.28 ± 




± 


0.28,,, 


3.6125 


1.69 ± 




± 


0.33,,, 


3.6155 


1.91 ± 


0.16 


+ 


0.37,,, 


3.6185 


1.87 ± 


0.15,,,, 


± 


0.36,,, 


3.6215 


1.94 ± 


0.l5,tat 


± 


0.38,,, 


3.6245 


2.62 ± 


0.18„„, 


+ 


0.44,v, 


3.6275 


2.33 ± 


0.18,,,, 


± 


0.48,,, 


3.6305 


3.37 ± 


0.19„„ 


± 


0.51,,, 


3.6335 


4.96 ± 


0.22„„, 


+ 


0.54,v, 


3.6365 


3.93 ± 


0.21„„ 


± 


0.45,,, 


3.6395 


2.21 ± 


0.17„„ 


± 


0.40,,, 


3.6425 


2.93 ± 


0.16„„, 


+ 


0.32,v, 


3.6455 


3.34 ± 


0.18„„ 


± 


0.48,,, 


3.6485 


2.96 ± 


0.15„«, 


± 


0.38,,, 


3.6515 


2.30 ± 


0.13„„, 


+ 


0.35,,, 


3.6545 


1.27 + 


0.08„„ 


± 




3.6575 


0.22 ± 


0.03„„, 


± 


0.04,,, 



Table 2: Differential cross section as a function of the squared invariant mass of the proton-;;' system, for the pp —> ppr]' 
reaction at Q = 16.4 MeV. 
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Figure 1: Schematic view of tlie COSY-1 1 detector facility f2l|l. Protons originating from the pp — > ppX reaction are 
bent in the dipole magnetic field, and leave the vacuum chamber through the exit window. Afterwards they are detected 
in the two drift chambers Dl and D2, in the scintillator hodoscopes SI and S2, and in the scintillator wall S3. The 
scintillation detector S4 and the silicon pad detector Si are used in coincidence with the Dl, D2 and SI detectors for the 
registration of the elastically scattered protons. 
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Figure 2: Spectrum of the difference between the simulated and reconstructed proton momentum. The dashed line 
denotes the spectrum before kinematical fit and the solid line corresponds to the situation after the fitting procedure. 
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Figure 3: Examples of experimental missing mass spectra for two intervals of Spp as indicated in the figure. The dotted 
lines indicate second order polynomials and the dashed lines show the sum of two Gaussian distributions. 
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Figure 4: Examples of measured missing mass spectra for the pp —> ppX reaction (solid lines) with superim- 
posed Monte-Carlo simulations of multi-pionic background (dashed lines). The missing mass spectra are presented 
for squared invariant proton-proton mass Spp e [3.577; 3.580] GeY^/c* (left) and squared invariant proton-;;' mass 
Sp^' 6 [3.602; 3.605] GeV^/c* (right). The dotted lines in both panels correspond to the fit of Equation[T] 
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Fi gure 5: Missing mass spectra for low values of Spj^ G [3.590; 3.593] GeV~/c'^ (left) ^nd high values of Spp E 
[3.586; 3.589] GeV-/c'^ (right). The dashed lines correspond to a linear sum of the simulated pp —> pplnr}, pp —> pp37T 
and pp — > pp47r reactions fitted to experimental distributions (solid Hues) using only the magnitudes as free parameters. 
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Figure 6: COSY- 11 detection acceptance as a function of Spp and Sp^j' squared invariant masses. Dalitz plot distribution 
was reconstructed from the events accepted by the COSY-1 1 detector setup. 
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Figure 7: Comparison of the proton-proton invariant mass squared distributions (Spp) (left) and of proton-meson kinetic 
energy ( yjSp-i„fsi,„ - nip - m„,gsi,n) (right)- Tlie distributions for the pp — » ppr]' reaction (filled squares) were normalized 
to the same total cross section as the pp — > pp;; reaction (open squares). Statistical and systematic errors were separated 
by horizontal dashes. 




Figure 8: Distributions of the squared proton-proton (Spp) and proton-;;' {Sp,y) invariant masses, for the pp — > ppif 
reaction at the excess energy of Q = 16.4 MeV. The experimental data (closed squares) are compared to the expecta- 
tion under the assumption of a homogeneously populated phase space (thick solid lines) and the integrals of the phase 
space weighted by the proton-proton scattering amplitude - FSIp,, (dotted histograms). The solid and dashed lines corre- 
spond to calculations when taking into account contributions from higher partial waves and allowing for a linear energy 
dependence of the ^Pq — »'So i partial wave amplitude, respectively. 
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